Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](spill) should call set_ready after changing the status #40075

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[fix](spill) should call set_ready after changing the status #40075

wants to merge 1 commit into from

Conversation

mrhhsg
Copy link
Member

@mrhhsg mrhhsg commented Aug 28, 2024

Proposed changes

After set_ready is called, other threads will access the Status variable, so to avoid conflicts, we should call set_ready after setting Status.

==15749==ERROR: AddressSanitizer: heap-use-after-free on address 0x606000793160 at pc 0x55d4f350092d bp 0x7f15320f5750 sp 0x7f15320f4f18
READ of size 48 at 0x606000793160 thread T1311 (Pipe_normal [wo)
    #0 0x55d4f350092c in __asan_memcpy (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x2fb4592c) (BuildId: faf5e280102bc969)
    #1 0x55d4f356126f in std::char_traits<char>::copy(char*, char const*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/char_traits.h:409:33
    #2 0x55d4f356126f in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_S_copy(char*, char const*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:351:4
    #3 0x55d4f356126f in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_S_copy_chars(char*, char*, char*) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:393:9
    #4 0x55d4f356126f in void std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_M_construct<char*>(char*, char*, std::forward_iterator_tag) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.tcc:225:6
    #5 0x55d4f389843b in void std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_M_construct_aux<char*>(char*, char*, std::__false_type) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:247:11
    #6 0x55d4f389843b in void std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_M_construct<char*>(char*, char*) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:266:4
    #7 0x55d4f389843b in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::basic_string(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:451:9
    #8 0x55d4f389843b in doris::Status::ErrMsg::ErrMsg(doris::Status::ErrMsg const&) /root/doris/be/src/common/status.h:552:12
    #9 0x55d4f389843b in std::_MakeUniq<doris::Status::ErrMsg>::__single_object std::make_unique<doris::Status::ErrMsg, doris::Status::ErrMsg&>(doris::Status::ErrMsg&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:962:34
    #10 0x55d4f38980d6 in doris::Status::operator=(doris::Status const&) /root/doris/be/src/common/status.h:380:24
    #11 0x55d5281fc948 in doris::Status::Status(doris::Status const&) /root/doris/be/src/common/status.h:371:39
    #12 0x55d5281fc948 in doris::pipeline::PartitionedAggSourceOperatorX::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) /root/doris/be/src/pipeline/exec/partitioned_aggregation_source_operator.cpp:137:5
    #13 0x55d524e72746 in doris::pipeline::OperatorXBase::get_block_after_projects(doris::RuntimeState*, doris::vectorized::Block*, bool*) /root/doris/be/src/pipeline/exec/operator.cpp:335:12
    #14 0x55d529430db1 in doris::pipeline::PipelineTask::execute(bool*) /root/doris/be/src/pipeline/pipeline_task.cpp:353:13
    #15 0x55d52946d6b3 in doris::pipeline::TaskScheduler::_do_work(unsigned long) /root/doris/be/src/pipeline/task_scheduler.cpp:138:9
    #16 0x55d4f7c2af5d in doris::ThreadPool::dispatch_thread() /root/doris/be/src/util/threadpool.cpp:543:24
    #17 0x55d4f7c0419e in std::function<void ()>::operator()() const /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:560:9
    #18 0x55d4f7c0419e in doris::Thread::supervise_thread(void*) /root/doris/be/src/util/thread.cpp:498:5
    #19 0x7f16e7e09608 in start_thread /build/glibc-SzIz7B/glibc-2.31/nptl/pthread_create.c:477:8
    #20 0x7f16e80b6132 in __clone /build/glibc-SzIz7B/glibc-2.31/misc/../sysdeps/unix/sysv/linux/x86_64/clone.S:95

0x606000793160 is located 0 bytes inside of 49-byte region [0x606000793160,0x606000793191)
freed by thread T549 (SpillIOThreadPo) here:
    #0 0x55d4f353c80d in operator delete(void*) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x2fb8180d) (BuildId: faf5e280102bc969)
    #1 0x55d4f38981a7 in __gnu_cxx::new_allocator<char>::deallocate(char*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/ext/new_allocator.h:139:2
    #2 0x55d4f38981a7 in std::allocator<char>::deallocate(char*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/allocator.h:187:27
    #3 0x55d4f38981a7 in std::allocator_traits<std::allocator<char>>::deallocate(std::allocator<char>&, char*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/alloc_traits.h:492:13
    #4 0x55d4f38981a7 in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_M_destroy(unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:237:9
    #5 0x55d4f38981a7 in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_M_dispose() /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:232:4
    #6 0x55d4f38981a7 in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::~basic_string() /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:658:9
    #7 0x55d4f38981a7 in doris::Status::ErrMsg::~ErrMsg() /root/doris/be/src/common/status.h:552:12
    #8 0x55d4f38981a7 in std::default_delete<doris::Status::ErrMsg>::operator()(doris::Status::ErrMsg*) const /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:85:2
    #9 0x55d4f38981a7 in std::__uniq_ptr_impl<doris::Status::ErrMsg, std::default_delete<doris::Status::ErrMsg>>::reset(doris::Status::ErrMsg*) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:182:4
    #10 0x55d4f38981a7 in std::__uniq_ptr_impl<doris::Status::ErrMsg, std::default_delete<doris::Status::ErrMsg>>::operator=(std::__uniq_ptr_impl<doris::Status::ErrMsg, std::default_delete<doris::Status::ErrMsg>>&&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:167:2
    #11 0x55d4f38981a7 in std::__uniq_ptr_data<doris::Status::ErrMsg, std::default_delete<doris::Status::ErrMsg>, true, true>::operator=(std::__uniq_ptr_data<doris::Status::ErrMsg, std::default_delete<doris::Status::ErrMsg>, true, true>&&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:212:61
    #12 0x55d4f38981a7 in std::unique_ptr<doris::Status::ErrMsg, std::default_delete<doris::Status::ErrMsg>>::operator=(std::unique_ptr<doris::Status::ErrMsg, std::default_delete<doris::Status::ErrMsg>>&&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:371:51
    #13 0x55d4f38981a7 in doris::Status::operator=(doris::Status const&) /root/doris/be/src/common/status.h:380:22
    #14 0x55d528203e1a in doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1::operator()() const /root/doris/be/src/pipeline/exec/partitioned_aggregation_source_operator.cpp:287:21
    #15 0x55d528203e1a in void std::__invoke_impl<void, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&>(std::__invoke_other, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:61:14
    #16 0x55d528203e1a in std::enable_if<is_invocable_r_v<void, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&>, void>::type std::__invoke_r<void, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&>(doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:111:2
    #17 0x55d528203e1a in std::_Function_handler<void (), doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1>::_M_invoke(std::_Any_data const&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291:9
    #18 0x55d5281f3506 in std::function<void ()>::operator()() const /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:560:9
    #19 0x55d5281f3506 in doris::pipeline::SpillRunnable::run() /root/doris/be/src/pipeline/exec/spill_utils.h:63:9
    #20 0x55d4f7c2af5d in doris::ThreadPool::dispatch_thread() /root/doris/be/src/util/threadpool.cpp:543:24
    #21 0x55d4f7c0419e in std::function<void ()>::operator()() const /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:560:9
    #22 0x55d4f7c0419e in doris::Thread::supervise_thread(void*) /root/doris/be/src/util/thread.cpp:498:5
    #23 0x7f16e7e09608 in start_thread /build/glibc-SzIz7B/glibc-2.31/nptl/pthread_create.c:477:8

previously allocated by thread T549 (SpillIOThreadPo) here:
    #0 0x55d4f353bfad in operator new(unsigned long) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x2fb80fad) (BuildId: faf5e280102bc969)
    #1 0x55d4f355ec2d in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_M_mutate(unsigned long, unsigned long, char const*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.tcc:307:21
    #2 0x55d4f35601a7 in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::_M_replace(unsigned long, unsigned long, char const*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.tcc:498:8
    #3 0x55d4f358aad2 in std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::assign(char const*, unsigned long) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:1429:9
    #4 0x55d4f358aad2 in std::enable_if<__and_<std::is_convertible<std::basic_string_view<char, std::char_traits<char>> const&, std::basic_string_view<char, std::char_traits<char>>>, std::__not_<std::is_convertible<std::basic_string_view<char, std::char_traits<char>> const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const*>>, std::__not_<std::is_convertible<std::basic_string_view<char, std::char_traits<char>> const&, char const*>>>::value, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>&>::type std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::assign<std::basic_string_view<char, std::char_traits<char>>>(std::basic_string_view<char, std::char_traits<char>> const&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:1502:17
    #5 0x55d4f358aad2 in std::enable_if<__and_<std::is_convertible<std::basic_string_view<char, std::char_traits<char>> const&, std::basic_string_view<char, std::char_traits<char>>>, std::__not_<std::is_convertible<std::basic_string_view<char, std::char_traits<char>> const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const*>>, std::__not_<std::is_convertible<std::basic_string_view<char, std::char_traits<char>> const&, char const*>>>::value, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>&>::type std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>::operator=<std::basic_string_view<char, std::char_traits<char>>>(std::basic_string_view<char, std::char_traits<char>> const&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:786:23
    #6 0x55d4f358aad2 in doris::Status doris::Status::Error<3, true>(std::basic_string_view<char, std::char_traits<char>>) /root/doris/be/src/common/status.h:414:35
    #7 0x55d524db0477 in doris::vectorized::SpillStream::read_next_block_sync(doris::vectorized::Block*, bool*) /root/doris/be/src/vec/spill/spill_stream.cpp:134:5
    #8 0x55d528202564 in doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_0::operator()() const /root/doris/be/src/pipeline/exec/partitioned_aggregation_source_operator.cpp:252:47
    #9 0x55d528202564 in doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1::operator()() const::'lambda'()::operator()() const /root/doris/be/src/pipeline/exec/partitioned_aggregation_source_operator.cpp:284:31
    #10 0x55d528202564 in doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1::operator()() const /root/doris/be/src/pipeline/exec/partitioned_aggregation_source_operator.cpp:284:23
    #11 0x55d528202564 in void std::__invoke_impl<void, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&>(std::__invoke_other, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:61:14
    #12 0x55d528202564 in std::enable_if<is_invocable_r_v<void, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&>, void>::type std::__invoke_r<void, doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&>(doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/invoke.h:111:2
    #13 0x55d528202564 in std::_Function_handler<void (), doris::pipeline::PartitionedAggLocalState::initiate_merge_spill_partition_agg_data(doris::RuntimeState*)::$_1>::_M_invoke(std::_Any_data const&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291:9
    #14 0x55d5281f3506 in std::function<void ()>::operator()() const /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:560:9
    #15 0x55d5281f3506 in doris::pipeline::SpillRunnable::run() /root/doris/be/src/pipeline/exec/spill_utils.h:63:9
    #16 0x55d4f7c2af5d in doris::ThreadPool::dispatch_thread() /root/doris/be/src/util/threadpool.cpp:543:24
    #17 0x55d4f7c0419e in std::function<void ()>::operator()() const /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:560:9
    #18 0x55d4f7c0419e in doris::Thread::supervise_thread(void*) /root/doris/be/src/util/thread.cpp:498:5
    #19 0x7f16e7e09608 in start_thread /build/glibc-SzIz7B/glibc-2.31/nptl/pthread_create.c:477:8

Thread T1311 (Pipe_normal [wo) created by T1307 here:
    #0 0x55d4f34e9caa in pthread_create (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x2fb2ecaa) (BuildId: faf5e280102bc969)
    #1 0x55d4f7c03190 in doris::Thread::start_thread(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, std::function<void ()> const&, unsigned long, scoped_refptr<doris::Thread>*) /root/doris/be/src/util/thread.cpp:449:15
    #2 0x55d4f7c326c1 in doris::Status doris::Thread::create<void (doris::ThreadPool::*)(), doris::ThreadPool*>(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, void (doris::ThreadPool::* const&)(), doris::ThreadPool* const&, scoped_refptr<doris::Thread>*) /root/doris/be/src/util/thread.h:56:16
    #3 0x55d4f7c29525 in doris::ThreadPool::create_thread() /root/doris/be/src/util/threadpool.cpp:611:12
    #4 0x55d4f7c28fce in doris::ThreadPool::init() /root/doris/be/src/util/threadpool.cpp:265:25
    #5 0x55d4f363bafa in doris::Status doris::ThreadPoolBuilder::build<doris::ThreadPool>(std::unique_ptr<doris::ThreadPool, std::default_delete<doris::ThreadPool>>*) const /root/doris/be/src/util/threadpool.h:121:13
    #6 0x55d52946b13c in doris::pipeline::TaskScheduler::start() /root/doris/be/src/pipeline/task_scheduler.cpp:55:5
    #7 0x55d4f770dfcd in doris::WorkloadGroup::upsert_task_scheduler(doris::WorkloadGroupInfo*, doris::ExecEnv*) /root/doris/be/src/runtime/workload_group/workload_group.cpp:442:47
    #8 0x55d4f36af10f in doris::WorkloadGroupListener::handle_topic_info(std::vector<doris::TopicInfo, std::allocator<doris::TopicInfo>> const&) /root/doris/be/src/agent/workload_group_listener.cpp:62:13
    #9 0x55d4f3684d11 in doris::TopicSubscriber::handle_topic_info(doris::TPublishTopicRequest const&) /root/doris/be/src/agent/topic_subscriber.cpp:48:35
    #10 0x55d4f7fbc03d in doris::BackendServiceProcessor::process_publish_topic_info(int, apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, void*) /root/doris/gensrc/build/gen_cpp/BackendService.cpp:8317:13
    #11 0x55d4f7f71439 in doris::BackendServiceProcessor::dispatchCall(apache::thrift::protocol::TProtocol*, apache::thrift::protocol::TProtocol*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, int, void*) /root/doris/gensrc/build/gen_cpp/BackendService.cpp:6886:3
    #12 0x55d4f8022423 in apache::thrift::TDispatchProcessor::process(std::shared_ptr<apache::thrift::protocol::TProtocol>, std::shared_ptr<apache::thrift::protocol::TProtocol>, void*) /var/local/thirdparty/installed/include/thrift/TDispatchProcessor.h:121:12
    #13 0x55d529e86a73 in apache::thrift::server::TConnectedClient::run() (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664cba73) (BuildId: faf5e280102bc969)
    #14 0x55d529e87e55 in apache::thrift::server::TThreadedServer::TConnectedClientRunner::run() (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664cce55) (BuildId: faf5e280102bc969)
    #15 0x55d529e8d1db in apache::thrift::concurrency::Thread::threadMain(std::shared_ptr<apache::thrift::concurrency::Thread>) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664d21db) (BuildId: faf5e280102bc969)
    #16 0x55d529e8c9f5 in void std::__invoke_impl<void, void (*)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>>(std::__invoke_other, void (*&&)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>&&) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664d19f5) (BuildId: faf5e280102bc969)
    #17 0x55d529e8c96c in std::__invoke_result<void (*)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>>::type std::__invoke<void (*)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>>(void (*&&)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>&&) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664d196c) (BuildId: faf5e280102bc969)
    #18 0x55d529e8c941 in void std::thread::_Invoker<std::tuple<void (*)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>>>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664d1941) (BuildId: faf5e280102bc969)
    #19 0x55d529e8c904 in std::thread::_Invoker<std::tuple<void (*)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>>>::operator()() (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664d1904) (BuildId: faf5e280102bc969)
    #20 0x55d529e8c768 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (*)(std::shared_ptr<apache::thrift::concurrency::Thread>), std::shared_ptr<apache::thrift::concurrency::Thread>>>>::_M_run() (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664d1768) (BuildId: faf5e280102bc969)
    #21 0x55d52c78b64f in execute_native_thread_routine /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/src/c++11/../../../../../libstdc++-v3/src/c++11/thread.cc:82:18

Thread T1307 created by T627 here:
    #0 0x55d4f34e9caa in pthread_create (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x2fb2ecaa) (BuildId: faf5e280102bc969)
    #1 0x55d52c78b775 in __gthread_create /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:663:35
    #2 0x55d52c78b775 in std::thread::_M_start_thread(std::unique_ptr<std::thread::_State, std::default_delete<std::thread::_State>>, void (*)()) /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/src/c++11/../../../../../libstdc++-v3/src/c++11/thread.cc:147:37
    #3 0x55d529e8be12 in apache::thrift::concurrency::Thread::start() (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664d0e12) (BuildId: faf5e280102bc969)
    #4 0x55d529e87b36 in apache::thrift::server::TThreadedServer::onClientConnected(std::shared_ptr<apache::thrift::server::TConnectedClient> const&) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664ccb36) (BuildId: faf5e280102bc969)
    #5 0x55d529e83e34 in apache::thrift::server::TServerFramework::newlyConnectedClient(std::shared_ptr<apache::thrift::server::TConnectedClient> const&) (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664c8e34) (BuildId: faf5e280102bc969)
    #6 0x55d529e8382e in apache::thrift::server::TServerFramework::serve() (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664c882e) (BuildId: faf5e280102bc969)
    #7 0x55d529e87898 in apache::thrift::server::TThreadedServer::serve() (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x664cc898) (BuildId: faf5e280102bc969)
    #8 0x55d4f7c51546 in doris::ThriftServer::ThriftServerEventProcessor::supervise() /root/doris/be/src/util/thrift_server.cpp:187:34
    #9 0x55d52c78b64f in execute_native_thread_routine /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/src/c++11/../../../../../libstdc++-v3/src/c++11/thread.cc:82:18

Thread T627 created by T0 here:
    #0 0x55d4f34e9caa in pthread_create (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x2fb2ecaa) (BuildId: faf5e280102bc969)
    #1 0x55d52c78b775 in __gthread_create /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:663:35
    #2 0x55d52c78b775 in std::thread::_M_start_thread(std::unique_ptr<std::thread::_State, std::default_delete<std::thread::_State>>, void (*)()) /data/gcc-11.1.0/build/x86_64-pc-linux-gnu/libstdc++-v3/src/c++11/../../../../../libstdc++-v3/src/c++11/thread.cc:147:37
    #3 0x55d4f7c4fd97 in std::_MakeUniq<std::thread>::__single_object std::make_unique<std::thread, void (doris::ThriftServer::ThriftServerEventProcessor::*)(), doris::ThriftServer::ThriftServerEventProcessor*>(void (doris::ThriftServer::ThriftServerEventProcessor::*&&)(), doris::ThriftServer::ThriftServerEventProcessor*&&) /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:962:34
    #4 0x55d4f7c4fd97 in doris::ThriftServer::ThriftServerEventProcessor::start_and_wait_for_server() /root/doris/be/src/util/thrift_server.cpp:152:38
    #5 0x55d4f7c575ba in doris::ThriftServer::start() /root/doris/be/src/util/thrift_server.cpp:402:5
    #6 0x55d4f3544e78 in main /root/doris/be/src/service/doris_main.cpp:566:25
    #7 0x7f16e7fbb082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16

Thread T549 (SpillIOThreadPo) created by T0 here:
    #0 0x55d4f34e9caa in pthread_create (/home/work/unlimit_teamcity/work/60183217f6ee2a9c/output/be/lib/doris_be+0x2fb2ecaa) (BuildId: faf5e280102bc969)
    #1 0x55d4f7c03190 in doris::Thread::start_thread(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, std::function<void ()> const&, unsigned long, scoped_refptr<doris::Thread>*) /root/doris/be/src/util/thread.cpp:449:15
    #2 0x55d4f7c326c1 in doris::Status doris::Thread::create<void (doris::ThreadPool::*)(), doris::ThreadPool*>(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>> const&, void (doris::ThreadPool::* const&)(), doris::ThreadPool* const&, scoped_refptr<doris::Thread>*) /root/doris/be/src/util/thread.h:56:16
    #3 0x55d4f7c29525 in doris::ThreadPool::create_thread() /root/doris/be/src/util/threadpool.cpp:611:12
    #4 0x55d4f7c28fce in doris::ThreadPool::init() /root/doris/be/src/util/threadpool.cpp:265:25
    #5 0x55d4f363bafa in doris::Status doris::ThreadPoolBuilder::build<doris::ThreadPool>(std::unique_ptr<doris::ThreadPool, std::default_delete<doris::ThreadPool>>*) const /root/doris/be/src/util/threadpool.h:121:13
    #6 0x55d524d91233 in doris::vectorized::SpillStreamManager::init() /root/doris/be/src/vec/spill/spill_stream_manager.cpp:80:32
    #7 0x55d4f70aaeae in doris::ExecEnv::_init(std::vector<doris::StorePath, std::allocator<doris::StorePath>> const&, std::vector<doris::StorePath, std::allocator<doris::StorePath>> const&, std::set<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>, std::less<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>>, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>>> const&) /root/doris/be/src/runtime/exec_env_init.cpp:367:5
    #8 0x55d4f70a543d in doris::ExecEnv::init(doris::ExecEnv*, std::vector<doris::StorePath, std::allocator<doris::StorePath>> const&, std::vector<doris::StorePath, std::allocator<doris::StorePath>> const&, std::set<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>, std::less<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>>, std::allocator<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char>>>> const&) /root/doris/be/src/runtime/exec_env_init.cpp:187:17
    #9 0x55d4f3543fb7 in main /root/doris/be/src/service/doris_main.cpp:532:14
    #10 0x7f16e7fbb082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@mrhhsg
Copy link
Member Author

mrhhsg commented Aug 28, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38159 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae0854ef3f8794cf12f658c7ab9316002084506e, data reload: false

------ Round 1 ----------------------------------
q1	17628	4379	4318	4318
q2	2020	184	173	173
q3	11729	969	1126	969
q4	10516	674	727	674
q5	7756	2838	2833	2833
q6	226	140	136	136
q7	966	610	608	608
q8	9290	2097	2079	2079
q9	7049	6561	6650	6561
q10	7004	2200	2265	2200
q11	491	248	248	248
q12	395	231	224	224
q13	18035	3046	3022	3022
q14	283	234	241	234
q15	526	492	487	487
q16	589	514	510	510
q17	990	684	769	684
q18	7335	6873	6954	6873
q19	1388	1051	1064	1051
q20	717	338	336	336
q21	4003	2919	3036	2919
q22	1116	1053	1020	1020
Total cold run time: 110052 ms
Total hot run time: 38159 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4448	4385	4352	4352
q2	385	272	270	270
q3	2889	2634	2702	2634
q4	1943	1620	1672	1620
q5	5629	5802	5903	5802
q6	232	143	141	141
q7	2353	1905	1904	1904
q8	3406	3517	3548	3517
q9	9102	9198	8924	8924
q10	3584	3407	3419	3407
q11	620	541	524	524
q12	865	658	669	658
q13	15789	3297	3103	3103
q14	319	289	318	289
q15	541	499	503	499
q16	613	577	584	577
q17	1853	1546	1524	1524
q18	8097	7752	7774	7752
q19	1737	1599	1500	1500
q20	2114	1925	1928	1925
q21	5687	5675	5275	5275
q22	1193	1085	1096	1085
Total cold run time: 73399 ms
Total hot run time: 57282 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192550 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae0854ef3f8794cf12f658c7ab9316002084506e, data reload: false

query1	1245	871	871	871
query2	6266	1899	1895	1895
query3	10595	3917	3927	3917
query4	59535	26802	23245	23245
query5	5582	518	496	496
query6	422	165	163	163
query7	5809	317	297	297
query8	310	237	217	217
query9	9012	2472	2478	2472
query10	485	266	263	263
query11	17954	15058	15355	15058
query12	157	104	105	104
query13	1536	385	383	383
query14	11079	6511	7378	6511
query15	239	176	188	176
query16	7689	472	467	467
query17	1212	611	595	595
query18	2078	309	296	296
query19	294	154	151	151
query20	121	115	108	108
query21	221	109	113	109
query22	4533	4370	4505	4370
query23	34264	33609	34021	33609
query24	5957	2930	2865	2865
query25	561	405	402	402
query26	696	164	156	156
query27	1777	288	286	286
query28	3695	2114	2091	2091
query29	735	424	422	422
query30	233	162	171	162
query31	939	788	774	774
query32	79	58	57	57
query33	481	291	293	291
query34	859	477	482	477
query35	858	724	746	724
query36	1075	954	950	950
query37	151	99	96	96
query38	3965	3917	3860	3860
query39	1438	1383	1398	1383
query40	209	118	116	116
query41	48	51	46	46
query42	122	98	99	98
query43	520	471	484	471
query44	1089	748	747	747
query45	202	170	172	170
query46	1094	748	756	748
query47	1877	1775	1811	1775
query48	371	306	300	300
query49	779	438	470	438
query50	812	430	417	417
query51	7295	7187	7087	7087
query52	99	93	90	90
query53	252	182	183	182
query54	575	462	463	462
query55	79	80	78	78
query56	293	281	267	267
query57	1181	1092	1122	1092
query58	219	226	243	226
query59	2970	2769	2753	2753
query60	400	264	269	264
query61	101	97	100	97
query62	727	649	659	649
query63	230	188	181	181
query64	2861	670	684	670
query65	3225	3161	3183	3161
query66	631	343	340	340
query67	15465	15368	15169	15169
query68	4399	576	560	560
query69	422	274	278	274
query70	1192	1061	1119	1061
query71	337	271	280	271
query72	6540	4047	3916	3916
query73	749	336	336	336
query74	9133	8839	8893	8839
query75	3401	2711	2705	2705
query76	1720	1036	1002	1002
query77	542	325	318	318
query78	9870	9098	9224	9098
query79	1752	532	535	532
query80	905	506	497	497
query81	568	237	237	237
query82	271	145	144	144
query83	254	154	144	144
query84	267	74	76	74
query85	959	289	284	284
query86	379	283	268	268
query87	4426	4207	4282	4207
query88	3778	2368	2336	2336
query89	393	284	294	284
query90	1898	195	187	187
query91	125	101	111	101
query92	60	55	53	53
query93	1670	542	562	542
query94	731	297	314	297
query95	358	267	265	265
query96	607	275	305	275
query97	3218	3127	3125	3125
query98	214	201	201	201
query99	1594	1254	1286	1254
Total cold run time: 310595 ms
Total hot run time: 192550 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.29 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ae0854ef3f8794cf12f658c7ab9316002084506e, data reload: false

query1	0.04	0.05	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.08	0.08
query5	0.50	0.50	0.48
query6	1.12	0.73	0.72
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.54	0.50	0.48
query10	0.54	0.52	0.54
query11	0.15	0.11	0.12
query12	0.15	0.12	0.13
query13	0.61	0.59	0.59
query14	2.03	2.01	2.04
query15	0.88	0.81	0.80
query16	0.37	0.38	0.37
query17	0.99	0.96	0.99
query18	0.22	0.22	0.21
query19	1.91	1.68	1.78
query20	0.01	0.00	0.01
query21	15.39	0.66	0.65
query22	3.96	7.51	2.34
query23	18.33	1.45	1.35
query24	2.06	0.22	0.23
query25	0.15	0.09	0.08
query26	0.27	0.18	0.18
query27	0.08	0.07	0.08
query28	13.34	1.02	1.00
query29	12.66	3.32	3.36
query30	0.25	0.06	0.05
query31	2.88	0.40	0.39
query32	3.26	0.48	0.47
query33	2.93	3.01	3.03
query34	17.03	4.37	4.40
query35	4.45	4.48	4.40
query36	0.64	0.49	0.49
query37	0.19	0.16	0.15
query38	0.17	0.16	0.15
query39	0.05	0.04	0.04
query40	0.15	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.03	0.05
Total cold run time: 110.54 s
Total hot run time: 32.29 s

@mrhhsg
Copy link
Member Author

mrhhsg commented Aug 29, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38093 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ae0854ef3f8794cf12f658c7ab9316002084506e, data reload: false

------ Round 1 ----------------------------------
q1	17933	4437	4483	4437
q2	2222	182	170	170
q3	10491	1086	1136	1086
q4	10133	800	673	673
q5	7719	2826	2792	2792
q6	226	143	143	143
q7	965	604	594	594
q8	9318	2072	2024	2024
q9	7272	6505	6511	6505
q10	7001	2192	2246	2192
q11	431	243	246	243
q12	397	227	227	227
q13	18961	3061	3012	3012
q14	296	243	239	239
q15	515	483	481	481
q16	573	521	505	505
q17	966	673	684	673
q18	7354	6771	6909	6771
q19	1404	1011	1037	1011
q20	691	338	336	336
q21	3891	3112	2970	2970
q22	1113	1029	1009	1009
Total cold run time: 109872 ms
Total hot run time: 38093 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4326	4317	4293	4293
q2	380	287	270	270
q3	2819	2698	2650	2650
q4	1927	1586	1646	1586
q5	5403	5398	5400	5398
q6	217	131	133	131
q7	2090	1746	1780	1746
q8	3221	3369	3387	3369
q9	8458	8487	8395	8395
q10	3475	3221	3210	3210
q11	612	510	503	503
q12	828	615	612	612
q13	12140	3028	3061	3028
q14	306	297	283	283
q15	531	477	484	477
q16	610	547	542	542
q17	1789	1496	1482	1482
q18	7770	7296	7295	7295
q19	1661	1642	1538	1538
q20	2027	1863	1842	1842
q21	5511	5299	5283	5283
q22	1143	1036	1041	1036
Total cold run time: 67244 ms
Total hot run time: 54969 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188343 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ae0854ef3f8794cf12f658c7ab9316002084506e, data reload: false

query1	912	378	366	366
query2	6456	1999	1946	1946
query3	6653	216	226	216
query4	27959	23194	23052	23052
query5	4230	493	488	488
query6	251	173	176	173
query7	4589	302	299	299
query8	251	228	207	207
query9	8527	2497	2492	2492
query10	435	283	276	276
query11	17894	14989	15114	14989
query12	155	104	97	97
query13	1637	377	384	377
query14	9459	7089	7215	7089
query15	265	174	183	174
query16	8095	472	478	472
query17	1574	587	546	546
query18	2134	293	295	293
query19	252	152	148	148
query20	120	116	112	112
query21	214	106	104	104
query22	4424	4214	4192	4192
query23	34143	33621	33427	33427
query24	11309	2915	2842	2842
query25	662	408	408	408
query26	1350	167	161	161
query27	2847	284	284	284
query28	7589	2153	2120	2120
query29	912	442	427	427
query30	308	179	156	156
query31	999	763	803	763
query32	112	59	67	59
query33	798	300	298	298
query34	949	484	485	484
query35	872	744	707	707
query36	1097	960	942	942
query37	172	96	94	94
query38	3981	3895	3983	3895
query39	1473	1385	1359	1359
query40	289	132	122	122
query41	53	49	49	49
query42	116	97	98	97
query43	512	492	492	492
query44	1222	764	761	761
query45	196	172	176	172
query46	1109	767	788	767
query47	1900	1788	1815	1788
query48	376	302	300	300
query49	1110	441	445	441
query50	805	414	426	414
query51	7332	7183	7046	7046
query52	98	90	89	89
query53	264	191	183	183
query54	961	458	466	458
query55	81	79	78	78
query56	288	274	270	270
query57	1221	1081	1095	1081
query58	258	232	240	232
query59	3068	2809	2914	2809
query60	302	294	281	281
query61	123	123	120	120
query62	983	678	676	676
query63	224	184	186	184
query64	5486	706	659	659
query65	3325	3166	3137	3137
query66	1418	339	340	339
query67	15788	15281	15284	15281
query68	4633	568	560	560
query69	533	378	293	293
query70	1192	1139	1111	1111
query71	410	273	273	273
query72	7019	3954	3742	3742
query73	778	332	334	332
query74	9155	8847	8891	8847
query75	3535	2684	2702	2684
query76	2878	975	1050	975
query77	666	321	338	321
query78	9894	9423	9048	9048
query79	2500	536	550	536
query80	1234	500	502	500
query81	588	239	233	233
query82	1136	145	149	145
query83	262	151	152	151
query84	235	75	75	75
query85	1650	280	278	278
query86	448	307	292	292
query87	4608	4231	4393	4231
query88	4181	2341	2374	2341
query89	395	297	283	283
query90	1811	198	200	198
query91	123	99	99	99
query92	65	54	50	50
query93	2193	553	535	535
query94	880	299	305	299
query95	359	262	265	262
query96	608	274	270	270
query97	3233	3061	3086	3061
query98	230	204	231	204
query99	1566	1317	1254	1254
Total cold run time: 293965 ms
Total hot run time: 188343 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.85 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ae0854ef3f8794cf12f658c7ab9316002084506e, data reload: false

query1	0.05	0.05	0.04
query2	0.09	0.04	0.04
query3	0.22	0.05	0.05
query4	1.69	0.07	0.07
query5	0.54	0.49	0.48
query6	1.14	0.73	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.50	0.49
query10	0.55	0.52	0.54
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.61	0.60	0.58
query14	2.03	2.03	2.06
query15	0.89	0.82	0.82
query16	0.39	0.38	0.38
query17	0.98	1.05	1.05
query18	0.21	0.20	0.20
query19	1.90	1.74	1.76
query20	0.01	0.01	0.01
query21	15.42	0.67	0.67
query22	3.70	7.24	2.58
query23	18.33	1.44	1.35
query24	2.13	0.23	0.22
query25	0.15	0.08	0.09
query26	0.28	0.19	0.18
query27	0.09	0.07	0.07
query28	13.23	1.04	1.02
query29	12.63	3.33	3.27
query30	0.24	0.06	0.05
query31	2.88	0.39	0.40
query32	3.26	0.49	0.47
query33	3.00	3.00	3.01
query34	16.88	4.42	4.41
query35	4.50	4.48	4.49
query36	0.65	0.49	0.49
query37	0.19	0.17	0.15
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.13	0.13
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.05	0.04
Total cold run time: 110.36 s
Total hot run time: 32.85 s

@mrhhsg
Copy link
Member Author

mrhhsg commented Aug 29, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38474 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 948b1a4a27dbf3fa561e1c0b34075d404f4f5e65, data reload: false

------ Round 1 ----------------------------------
q1	17841	4551	4398	4398
q2	2598	186	174	174
q3	11052	1131	1168	1131
q4	10329	734	737	734
q5	7808	2910	2869	2869
q6	239	139	156	139
q7	980	633	609	609
q8	9528	2091	2080	2080
q9	7063	6555	6522	6522
q10	7034	2209	2192	2192
q11	468	243	244	243
q12	411	230	229	229
q13	18001	3051	3045	3045
q14	276	236	235	235
q15	529	479	492	479
q16	577	531	496	496
q17	985	689	687	687
q18	7341	6762	6828	6762
q19	1393	1125	1118	1118
q20	709	344	327	327
q21	4127	2981	3113	2981
q22	1125	1024	1048	1024
Total cold run time: 110414 ms
Total hot run time: 38474 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4349	4338	4310	4310
q2	372	259	272	259
q3	2897	2697	2662	2662
q4	1921	1668	1676	1668
q5	5411	5400	5424	5400
q6	219	129	133	129
q7	2139	1757	1754	1754
q8	3212	3363	3322	3322
q9	8400	8388	8412	8388
q10	3484	3199	3204	3199
q11	593	523	503	503
q12	820	621	621	621
q13	11505	3075	3059	3059
q14	301	277	284	277
q15	526	481	491	481
q16	635	572	580	572
q17	1794	1512	1461	1461
q18	7694	7596	7465	7465
q19	1683	1430	1585	1430
q20	2057	1845	1784	1784
q21	5403	5196	5149	5149
q22	1128	1043	1033	1033
Total cold run time: 66543 ms
Total hot run time: 54926 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188831 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 948b1a4a27dbf3fa561e1c0b34075d404f4f5e65, data reload: false

query1	910	382	360	360
query2	6466	2024	1993	1993
query3	6658	215	221	215
query4	34216	23256	23104	23104
query5	4164	493	483	483
query6	257	163	176	163
query7	4592	296	288	288
query8	259	218	210	210
query9	8799	2511	2470	2470
query10	446	305	270	270
query11	17967	15165	15033	15033
query12	149	99	97	97
query13	1629	371	367	367
query14	9536	7315	7359	7315
query15	293	172	185	172
query16	7926	485	440	440
query17	1599	576	560	560
query18	1769	303	304	303
query19	271	156	154	154
query20	119	113	114	113
query21	210	105	109	105
query22	4473	4236	4134	4134
query23	34084	33738	33555	33555
query24	11263	2934	2843	2843
query25	659	417	404	404
query26	1355	169	165	165
query27	2681	291	281	281
query28	7376	2134	2113	2113
query29	880	443	428	428
query30	302	167	156	156
query31	1000	775	795	775
query32	103	61	64	61
query33	784	294	304	294
query34	957	480	500	480
query35	863	733	731	731
query36	1118	909	936	909
query37	163	98	93	93
query38	4028	3847	3889	3847
query39	1436	1404	1409	1404
query40	280	120	121	120
query41	52	50	50	50
query42	119	99	100	99
query43	506	494	464	464
query44	1214	763	763	763
query45	198	167	172	167
query46	1110	770	751	751
query47	1878	1814	1859	1814
query48	377	296	298	296
query49	1120	454	434	434
query50	816	422	423	422
query51	7261	7064	7152	7064
query52	103	92	90	90
query53	263	193	180	180
query54	1077	468	474	468
query55	81	80	82	80
query56	306	281	272	272
query57	1198	1092	1082	1082
query58	258	233	239	233
query59	2948	2861	2754	2754
query60	309	282	288	282
query61	217	101	101	101
query62	851	661	653	653
query63	209	186	180	180
query64	5334	679	663	663
query65	3236	3160	3199	3160
query66	1358	341	363	341
query67	16187	15245	15279	15245
query68	4612	558	562	558
query69	431	265	274	265
query70	1182	1067	1059	1059
query71	342	277	267	267
query72	6705	3980	4045	3980
query73	765	336	331	331
query74	9363	8865	8881	8865
query75	3427	2666	2646	2646
query76	2686	1040	1004	1004
query77	497	324	333	324
query78	9855	9019	9987	9019
query79	2868	542	547	542
query80	1033	512	502	502
query81	592	240	230	230
query82	605	144	142	142
query83	216	153	155	153
query84	234	126	80	80
query85	1644	292	283	283
query86	493	300	311	300
query87	4467	4236	4334	4236
query88	3769	2350	2361	2350
query89	394	296	289	289
query90	1848	190	194	190
query91	131	111	105	105
query92	71	60	57	57
query93	1760	564	556	556
query94	935	305	295	295
query95	351	275	262	262
query96	607	273	314	273
query97	3258	3101	3071	3071
query98	216	209	215	209
query99	1596	1280	1272	1272
Total cold run time: 297579 ms
Total hot run time: 188831 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.42 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 948b1a4a27dbf3fa561e1c0b34075d404f4f5e65, data reload: false

query1	0.04	0.05	0.04
query2	0.07	0.04	0.04
query3	0.23	0.05	0.05
query4	1.69	0.08	0.09
query5	0.50	0.48	0.49
query6	1.14	0.73	0.72
query7	0.02	0.02	0.01
query8	0.06	0.04	0.04
query9	0.55	0.48	0.48
query10	0.54	0.53	0.54
query11	0.15	0.12	0.12
query12	0.15	0.13	0.12
query13	0.61	0.58	0.58
query14	2.07	2.07	2.13
query15	0.90	0.82	0.82
query16	0.38	0.37	0.37
query17	1.04	1.00	1.03
query18	0.21	0.20	0.20
query19	1.91	1.79	1.73
query20	0.01	0.01	0.01
query21	15.40	0.68	0.68
query22	4.09	6.86	2.32
query23	18.22	1.40	1.27
query24	2.11	0.24	0.24
query25	0.17	0.08	0.08
query26	0.25	0.18	0.17
query27	0.08	0.07	0.08
query28	13.23	1.03	1.01
query29	12.62	3.34	3.26
query30	0.24	0.06	0.06
query31	2.87	0.40	0.39
query32	3.27	0.48	0.47
query33	2.92	3.00	3.00
query34	17.37	4.44	4.40
query35	4.42	4.44	4.50
query36	0.65	0.50	0.47
query37	0.18	0.15	0.16
query38	0.16	0.15	0.16
query39	0.04	0.03	0.05
query40	0.15	0.13	0.14
query41	0.09	0.05	0.05
query42	0.06	0.05	0.05
query43	0.06	0.04	0.04
Total cold run time: 110.92 s
Total hot run time: 32.42 s

@mrhhsg
Copy link
Member Author

mrhhsg commented Aug 29, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38203 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 70203c515258ad71a544c3c4ec76f7a65a06cd66, data reload: false

------ Round 1 ----------------------------------
q1	17623	4691	4302	4302
q2	2014	180	181	180
q3	11659	949	1167	949
q4	10515	807	681	681
q5	7760	2876	2812	2812
q6	233	143	140	140
q7	981	621	598	598
q8	9342	2108	2124	2108
q9	7145	6565	6575	6565
q10	7064	2225	2253	2225
q11	462	247	249	247
q12	415	227	229	227
q13	17769	3053	3075	3053
q14	278	255	235	235
q15	524	487	499	487
q16	608	539	502	502
q17	1009	744	674	674
q18	7408	6853	6834	6834
q19	1392	1004	1014	1004
q20	693	339	343	339
q21	4075	3038	3030	3030
q22	1098	1020	1011	1011
Total cold run time: 110067 ms
Total hot run time: 38203 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4386	4327	4284	4284
q2	384	287	280	280
q3	2941	2696	2659	2659
q4	1976	1712	1684	1684
q5	5734	5742	5835	5742
q6	237	141	139	139
q7	2315	1862	1878	1862
q8	3361	3489	3568	3489
q9	8943	8905	8903	8903
q10	3672	3421	3349	3349
q11	610	517	519	517
q12	848	700	678	678
q13	15001	3217	3337	3217
q14	324	290	295	290
q15	544	483	490	483
q16	621	583	569	569
q17	1867	1535	1561	1535
q18	8325	7986	8046	7986
q19	1745	1585	1610	1585
q20	2153	1945	1932	1932
q21	5871	5725	5644	5644
q22	1135	1057	1011	1011
Total cold run time: 72993 ms
Total hot run time: 57838 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195710 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 70203c515258ad71a544c3c4ec76f7a65a06cd66, data reload: false

query1	1264	889	853	853
query2	6173	2015	2005	2005
query3	10608	3991	3965	3965
query4	59406	24898	23463	23463
query5	5443	515	524	515
query6	411	165	169	165
query7	5773	322	300	300
query8	295	217	227	217
query9	8737	2482	2484	2482
query10	475	290	274	274
query11	18127	15152	15512	15152
query12	161	111	112	111
query13	1516	431	397	397
query14	11354	8057	7880	7880
query15	257	178	195	178
query16	7124	492	488	488
query17	1103	594	592	592
query18	1342	293	317	293
query19	291	155	157	155
query20	127	112	111	111
query21	210	107	108	107
query22	4742	4341	4328	4328
query23	34255	35300	34049	34049
query24	5986	3007	2874	2874
query25	498	386	394	386
query26	680	161	165	161
query27	1765	289	287	287
query28	3735	2125	2097	2097
query29	636	417	419	417
query30	238	155	154	154
query31	983	774	765	765
query32	82	57	61	57
query33	416	289	286	286
query34	886	489	484	484
query35	856	737	722	722
query36	1098	946	938	938
query37	152	96	96	96
query38	4148	3885	3960	3885
query39	1461	1411	1396	1396
query40	204	126	123	123
query41	48	47	46	46
query42	118	102	99	99
query43	532	475	480	475
query44	1134	754	758	754
query45	204	176	169	169
query46	1113	788	775	775
query47	1920	1782	1816	1782
query48	397	342	294	294
query49	765	447	445	445
query50	851	432	419	419
query51	7221	7121	7078	7078
query52	104	88	90	88
query53	269	184	183	183
query54	570	462	466	462
query55	80	77	75	75
query56	295	278	265	265
query57	1193	1086	1069	1069
query58	218	244	236	236
query59	3116	2707	2752	2707
query60	302	273	280	273
query61	102	100	142	100
query62	756	645	650	645
query63	216	192	193	192
query64	2817	697	672	672
query65	3245	3197	3224	3197
query66	618	349	347	347
query67	15384	15190	15266	15190
query68	2909	602	607	602
query69	454	283	296	283
query70	1165	1168	1133	1133
query71	358	285	281	281
query72	5740	4056	4137	4056
query73	793	334	346	334
query74	9215	8922	8965	8922
query75	3424	2724	2729	2724
query76	1585	1019	986	986
query77	589	321	342	321
query78	9839	9123	9238	9123
query79	1103	578	546	546
query80	734	522	522	522
query81	458	238	237	237
query82	248	146	149	146
query83	175	154	154	154
query84	253	78	86	78
query85	702	285	282	282
query86	303	299	295	295
query87	4690	4433	4451	4433
query88	3304	2436	2435	2435
query89	386	295	292	292
query90	1968	207	206	206
query91	139	189	103	103
query92	62	55	54	54
query93	1103	546	551	546
query94	619	302	287	287
query95	337	274	272	272
query96	605	268	268	268
query97	3207	3065	3133	3065
query98	224	208	202	202
query99	1559	1277	1300	1277
Total cold run time: 304856 ms
Total hot run time: 195710 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.53 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 70203c515258ad71a544c3c4ec76f7a65a06cd66, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.23	0.06	0.05
query4	1.65	0.08	0.07
query5	0.50	0.49	0.50
query6	1.15	0.73	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.56	0.49	0.50
query10	0.54	0.55	0.54
query11	0.16	0.12	0.12
query12	0.15	0.12	0.13
query13	0.62	0.59	0.60
query14	2.04	2.06	2.07
query15	0.86	0.82	0.83
query16	0.36	0.36	0.35
query17	1.00	1.00	1.01
query18	0.21	0.20	0.21
query19	1.89	1.85	1.85
query20	0.01	0.02	0.01
query21	15.39	0.66	0.66
query22	3.91	7.07	1.98
query23	18.29	1.45	1.37
query24	2.09	0.26	0.25
query25	0.16	0.09	0.09
query26	0.28	0.17	0.17
query27	0.10	0.09	0.09
query28	13.27	1.04	1.02
query29	12.68	3.41	3.39
query30	0.27	0.07	0.05
query31	2.87	0.40	0.39
query32	3.25	0.50	0.49
query33	3.03	3.06	3.02
query34	17.22	4.40	4.40
query35	4.47	4.44	4.42
query36	0.66	0.51	0.50
query37	0.19	0.16	0.16
query38	0.15	0.16	0.15
query39	0.04	0.04	0.04
query40	0.16	0.13	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.06
query43	0.05	0.04	0.04
Total cold run time: 110.8 s
Total hot run time: 32.53 s

@mrhhsg
Copy link
Member Author

mrhhsg commented Aug 29, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 37368 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2b83758a37f5a2beffef93609e00114f7d006cc6, data reload: false

------ Round 1 ----------------------------------
q1	17618	4369	4229	4229
q2	2012	186	176	176
q3	11811	948	1093	948
q4	10520	705	733	705
q5	7780	2823	2779	2779
q6	227	142	142	142
q7	949	605	594	594
q8	9320	2027	2045	2027
q9	7175	6476	6525	6476
q10	6997	2161	2153	2153
q11	444	241	241	241
q12	407	220	220	220
q13	17748	3003	3025	3003
q14	269	231	230	230
q15	503	489	498	489
q16	581	510	500	500
q17	970	688	669	669
q18	7354	6841	6719	6719
q19	1393	1024	1042	1024
q20	688	330	330	330
q21	3925	2709	2766	2709
q22	1115	1005	1015	1005
Total cold run time: 109806 ms
Total hot run time: 37368 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4341	4295	4319	4295
q2	381	266	271	266
q3	2893	2624	2638	2624
q4	1901	1643	1632	1632
q5	5555	5668	5627	5627
q6	230	132	131	131
q7	2293	1798	1826	1798
q8	3285	3414	3428	3414
q9	8805	8755	8786	8755
q10	3550	3256	3357	3256
q11	589	514	508	508
q12	855	638	662	638
q13	14882	3108	3271	3108
q14	312	293	298	293
q15	537	501	484	484
q16	623	598	563	563
q17	1827	1553	1525	1525
q18	8045	7819	7882	7819
q19	1705	1656	1609	1609
q20	2144	1880	1901	1880
q21	5763	5310	5551	5310
q22	1090	1052	1022	1022
Total cold run time: 71606 ms
Total hot run time: 56557 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193346 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2b83758a37f5a2beffef93609e00114f7d006cc6, data reload: false

query1	1250	865	864	864
query2	6275	2012	1967	1967
query3	10622	3946	3970	3946
query4	59957	25131	23267	23267
query5	5370	490	491	490
query6	396	163	185	163
query7	5790	301	301	301
query8	287	234	216	216
query9	8887	2506	2485	2485
query10	512	279	280	279
query11	18357	15270	15410	15270
query12	171	105	108	105
query13	1561	410	373	373
query14	11131	7454	7337	7337
query15	230	176	187	176
query16	7623	472	483	472
query17	1085	573	564	564
query18	1899	298	288	288
query19	289	145	148	145
query20	127	117	110	110
query21	205	102	102	102
query22	4621	4415	4488	4415
query23	34320	33595	33286	33286
query24	5936	2905	2890	2890
query25	551	396	408	396
query26	695	161	157	157
query27	1786	278	284	278
query28	3916	2108	2108	2108
query29	697	421	425	421
query30	234	157	156	156
query31	940	753	761	753
query32	90	58	59	58
query33	491	291	286	286
query34	857	478	474	474
query35	833	731	707	707
query36	1076	896	949	896
query37	154	101	94	94
query38	4001	3828	3840	3828
query39	1463	1402	1377	1377
query40	202	122	117	117
query41	49	46	43	43
query42	116	99	96	96
query43	506	481	501	481
query44	1088	750	749	749
query45	203	168	168	168
query46	1089	738	747	738
query47	1871	1801	1809	1801
query48	369	299	292	292
query49	772	436	447	436
query50	810	417	417	417
query51	7113	7153	6984	6984
query52	99	88	87	87
query53	251	180	187	180
query54	571	466	469	466
query55	81	81	81	81
query56	283	273	272	272
query57	1218	1040	1093	1040
query58	238	240	232	232
query59	3112	2867	2887	2867
query60	297	281	275	275
query61	123	122	117	117
query62	753	650	666	650
query63	222	189	190	189
query64	2965	781	753	753
query65	3194	3160	3114	3114
query66	686	352	360	352
query67	15315	15358	15194	15194
query68	4382	576	564	564
query69	549	284	271	271
query70	1168	1128	1117	1117
query71	371	277	279	277
query72	6625	4025	4033	4025
query73	752	334	333	333
query74	9251	8821	8864	8821
query75	3366	2688	2688	2688
query76	1768	987	1058	987
query77	554	333	327	327
query78	9789	9102	9047	9047
query79	1988	524	530	524
query80	1152	501	502	501
query81	565	236	233	233
query82	981	152	148	148
query83	174	151	145	145
query84	263	73	77	73
query85	913	336	285	285
query86	368	286	296	286
query87	4448	4202	4120	4120
query88	2996	2359	2334	2334
query89	386	281	287	281
query90	1891	198	194	194
query91	123	100	103	100
query92	65	58	62	58
query93	2369	541	536	536
query94	788	301	310	301
query95	354	261	261	261
query96	623	270	272	270
query97	3195	3061	3061	3061
query98	229	215	202	202
query99	1661	1285	1285	1285
Total cold run time: 312388 ms
Total hot run time: 193346 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.73 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2b83758a37f5a2beffef93609e00114f7d006cc6, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.08	0.07
query5	0.50	0.49	0.50
query6	1.12	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.55	0.47	0.48
query10	0.55	0.54	0.54
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.60	0.58	0.57
query14	2.06	2.07	2.12
query15	0.88	0.83	0.81
query16	0.37	0.37	0.38
query17	1.07	1.05	0.98
query18	0.20	0.20	0.19
query19	1.80	1.72	1.81
query20	0.01	0.01	0.00
query21	15.39	0.68	0.67
query22	4.24	7.66	1.73
query23	18.30	1.38	1.24
query24	2.07	0.22	0.23
query25	0.14	0.08	0.08
query26	0.27	0.19	0.17
query27	0.08	0.08	0.08
query28	13.28	1.02	1.01
query29	12.61	3.35	3.34
query30	0.23	0.06	0.05
query31	2.86	0.39	0.39
query32	3.29	0.49	0.48
query33	2.96	2.98	2.97
query34	16.80	4.45	4.43
query35	4.46	4.46	4.39
query36	0.66	0.50	0.46
query37	0.19	0.17	0.16
query38	0.16	0.15	0.16
query39	0.05	0.04	0.05
query40	0.17	0.12	0.13
query41	0.10	0.05	0.05
query42	0.05	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 110.51 s
Total hot run time: 31.73 s

@mrhhsg
Copy link
Member Author

mrhhsg commented Aug 31, 2024

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38245 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 68120c45af300e12c1a838b24c77a8399dc3e6f3, data reload: false

------ Round 1 ----------------------------------
q1	18166	4547	4318	4318
q2	2024	206	194	194
q3	10780	1142	1095	1095
q4	10457	715	728	715
q5	7914	2918	2835	2835
q6	230	138	139	138
q7	982	633	602	602
q8	9515	2119	2074	2074
q9	7257	6627	6617	6617
q10	7099	2253	2289	2253
q11	478	232	245	232
q12	392	227	223	223
q13	17768	3018	3004	3004
q14	274	232	230	230
q15	524	491	488	488
q16	608	500	525	500
q17	978	590	685	590
q18	7260	6819	6873	6819
q19	1393	1073	1068	1068
q20	676	329	329	329
q21	4321	2897	2982	2897
q22	1141	1046	1024	1024
Total cold run time: 110237 ms
Total hot run time: 38245 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4390	4277	4231	4231
q2	378	278	270	270
q3	2886	2630	2627	2627
q4	1945	1726	1652	1652
q5	5597	5698	5695	5695
q6	225	135	137	135
q7	2272	1791	1768	1768
q8	3329	3478	3502	3478
q9	8768	8731	8714	8714
q10	3580	3370	3317	3317
q11	610	499	506	499
q12	849	638	656	638
q13	11744	3203	3195	3195
q14	305	285	293	285
q15	534	481	477	477
q16	653	605	546	546
q17	1820	1538	1521	1521
q18	8306	7837	7865	7837
q19	1692	1543	1629	1543
q20	2165	1915	1799	1799
q21	5604	5551	5440	5440
q22	1187	1102	1081	1081
Total cold run time: 68839 ms
Total hot run time: 56748 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193247 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 68120c45af300e12c1a838b24c77a8399dc3e6f3, data reload: false

query1	1240	874	840	840
query2	6197	2062	1999	1999
query3	10754	4146	4182	4146
query4	59669	26779	23319	23319
query5	5380	507	490	490
query6	406	164	159	159
query7	5774	295	292	292
query8	294	199	202	199
query9	9049	2464	2478	2464
query10	487	267	269	267
query11	18132	15151	15439	15151
query12	162	109	108	108
query13	1571	402	392	392
query14	11139	7523	7334	7334
query15	258	175	191	175
query16	7506	495	504	495
query17	1133	614	568	568
query18	1997	312	314	312
query19	294	161	158	158
query20	122	116	116	116
query21	209	109	114	109
query22	4630	4303	4495	4303
query23	34427	34645	33612	33612
query24	5915	2885	2828	2828
query25	490	379	374	374
query26	670	152	169	152
query27	1767	270	274	270
query28	3793	2116	2125	2116
query29	626	404	400	400
query30	236	149	158	149
query31	937	699	775	699
query32	77	57	54	54
query33	451	286	287	286
query34	853	482	468	468
query35	848	726	705	705
query36	1050	915	905	905
query37	142	93	88	88
query38	3988	3968	3861	3861
query39	1427	1395	1402	1395
query40	214	120	112	112
query41	50	44	49	44
query42	113	97	93	93
query43	515	471	474	471
query44	1084	741	742	741
query45	193	161	164	161
query46	1081	718	707	707
query47	1925	1805	1814	1805
query48	373	303	280	280
query49	747	428	432	428
query50	811	415	401	401
query51	7171	6997	7018	6997
query52	102	87	92	87
query53	256	187	186	186
query54	578	447	462	447
query55	78	75	76	75
query56	272	255	249	249
query57	1202	1060	1064	1060
query58	220	251	222	222
query59	3050	2857	2778	2778
query60	302	264	259	259
query61	103	100	102	100
query62	751	657	649	649
query63	216	190	188	188
query64	2809	718	670	670
query65	3222	3178	3199	3178
query66	658	353	339	339
query67	15419	15311	15344	15311
query68	3017	584	584	584
query69	406	277	274	274
query70	1158	1024	1073	1024
query71	337	274	276	274
query72	5784	4039	3964	3964
query73	750	326	331	326
query74	9089	9053	8784	8784
query75	3335	2622	2688	2622
query76	1487	967	971	967
query77	525	303	305	303
query78	11143	9661	9126	9126
query79	1056	542	518	518
query80	689	491	512	491
query81	465	235	231	231
query82	600	145	151	145
query83	174	146	144	144
query84	253	74	75	74
query85	677	286	321	286
query86	302	299	298	298
query87	4413	4281	4238	4238
query88	3048	2313	2308	2308
query89	393	289	288	288
query90	1909	191	194	191
query91	122	100	98	98
query92	64	51	54	51
query93	1044	540	533	533
query94	631	294	267	267
query95	350	256	259	256
query96	592	266	267	266
query97	3184	3053	3048	3048
query98	214	211	209	209
query99	1529	1263	1266	1263
Total cold run time: 306355 ms
Total hot run time: 193247 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.08 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 68120c45af300e12c1a838b24c77a8399dc3e6f3, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.23	0.04	0.04
query4	1.68	0.08	0.07
query5	0.51	0.49	0.48
query6	1.14	0.74	0.72
query7	0.01	0.01	0.01
query8	0.05	0.05	0.05
query9	0.54	0.49	0.49
query10	0.54	0.54	0.54
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.61	0.59	0.59
query14	2.02	2.05	2.11
query15	0.83	0.83	0.82
query16	0.35	0.39	0.36
query17	1.07	0.98	1.07
query18	0.22	0.20	0.20
query19	1.94	1.77	1.88
query20	0.01	0.01	0.01
query21	15.40	0.65	0.66
query22	3.94	7.37	2.05
query23	18.30	1.37	1.24
query24	2.13	0.23	0.21
query25	0.15	0.08	0.09
query26	0.27	0.18	0.17
query27	0.08	0.09	0.08
query28	13.20	1.01	1.00
query29	12.60	3.28	3.31
query30	0.24	0.06	0.05
query31	2.90	0.41	0.39
query32	3.23	0.47	0.48
query33	2.94	2.97	3.04
query34	17.16	4.46	4.42
query35	4.52	4.44	4.50
query36	0.66	0.47	0.47
query37	0.18	0.16	0.15
query38	0.15	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.13	0.13
query41	0.09	0.05	0.05
query42	0.07	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.66 s
Total hot run time: 32.08 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 31, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yiguolei yiguolei yiguolei approved these changes

@jacktengg jacktengg jacktengg approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@mrhhsg @doris-robot @yiguolei @jacktengg